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Io  Introduction 

On  April  1,  1951,  a research  project  on  tha  statistics  of  lifa  and 
fatigue  tasting  vws  initiatad  at  Wayne  Univarsity.  Tha  principal  objective 
of  tha  rest  .rch  was  to  davalop  statistical  techniques  of  estimation  and 
decision  raking  which  make  sextans  use  of  tha  information  arising  from  lifa 
and  fatigue  tests.  A characteristic  feature  of  such  tests  is  that  information 
becomes  arailabla  continuously  and  failure  a whan  they  do  occur  are  naturally 
ordered  (a.g. , in  tiam).  In  tin  course  of  this  research  wa  have  triad  ta 
davalop  statistical  procedures  in  lifa  tasting  which  are  optimum  in  that  wa 
gat  tha  most  information  out  of  the  data  for  tha  least  overall  cost,  in  time 
and  number  of  items  destroyed. 

Tbs  research  dona  under  this  project  represents  substantial  progress 
It  a field  about  which  little  known  two  or  three  years  ago.  On  tbs 
theeretioal  side  fundamental  work  has  been  dona  in  estimation  and  hypothesis 


tasting,  xn  stochastic  processes,  contiiisous  «u*u  ordlna s.^asitiu  analysis. 
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non-pa raaetric  theory,  and  order  statistics.  Tbs  research  has  stimulated 
interact  in  lifa  tasting  and  has  drawn  tha  attention  of  other  mathematical 
statisticians  to  sans  of  the  important  problems  in  this  field.  On  tha 
applied  side  it  has  been  clear  from  tha  start  that  the  results  would  be  uae- 
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ful  In  fields  as  diverse  as  life  testing  of  electron  tubes  to  follow-up 
studies  on  the  effectiveness  of  iaedical  treatment.  The  potential  applications 
are  very  numerous  indeed. 

In  the  eequel  we  shall  give  the  loll  owing: 

Section  II:  Personnel  on  the  project,, 

Section  III:  Reports  and  papers  resulting  from  the  projects 

Summary  of  the  results  obtained  under  the  project. 

Related  work  by  other  mathematical  statist  iciaas0 
Some  remarks  on  the  applications  of  this  worko 


Section  IV: 
Section  V: 
Section  VI: 


IIo  Personnel  on  the  project 

Tr  folloving  members  of  the  Wayne  University  staff  have  been 
connected  v.lth  the  research  project. 

Professor  Benjamin  Epstein,  Project  Director,  April  1,  1951-January  31* 
Professor  Milton  Sobel,  April  1,  1951-Februazy  1,  1952. 

Mr.  C.  Ii.  Kraft,  September  15,  1951-June  15,  1952<> 

Professor  C.  K.  Tsao,  February  1,  19  32-Sept  ember  1,  1953* 

In  addition  there  were 

Mrs.  Dorothy  Wolfe,  Graduate  Assistant,  September  15,  1951-June  1,  1953, 
and  several  student  assistants  who  performed  calculations,  typed  reports,  did 
clerical  work,  etc0 

II Jo  Reports  and  papers  resulting  from  the  project 
A.  The  following  reports  have  been  issued* 

(1)  "Some  Tests  Based  on  the  First  r Ordered  Observations  Drawn  from 
an  Exponential  Distribution",  by  B.  Epstein  and  M„  Sobel0  Issued 
March  1,  1952,  as  Wayne  thiversity  Report  No.  1 and  Stanford 
University  Report  No.  6. 

(2)  "Estimates  of  Mean  Life  Based  on  the  r'th  Smallest  Value  in  a 
Sample  of  Size  n Drawn  from  an  Exponential  Distribution",  by 
B.  Epstein.  Issued  July  1,  1952,  as  Technical  Report  No.  2. 

(3)  "Sons  Two  Sample  Tests  Based  on  Ordered  Observations  from  the 
Exponential  Distribution",  by  B.  Epstein  and  C.  K.  Tsao.  Issued 
December  15,  1952,  as  Technical  Report  No.  % 

(4)  "Some  Results  on  Truncated  Life  Tests  in  the  Exponential  Case”, 


by  B.  Epstein.  Issued  February  15,  1953,  aa  Technical  Report  No.  U 


(5) 

(6) 

(7) 

(8) 


B.  Paps re 
(1) 

(2) 

(3) 

(4) 

(5) 


k 

"Ope rating  Characteristic  Curves  and  Other  Features  of  Truncated 
life  Tests  with  Replacement",  by  B.  Epstein,  Issued  May  15,  1953p 
as  Technical  Report  No.  5° 

"Tables  for  the  Distribution  of  the  Number  of  Exceedances",  by 
B0  Epstein.  Issued  July  15,  1953,  as  Technical  Report  No,  60 
"An  Extension  of  Massey* s Distribution  of  the  Maximum  Deviation 
Between  Two  Sample  Cumulative  Step  Functions",  by  C.  K.  Tsao. 
Issued  July  15,  1953,  as  Technical  Report  No.  7° 

"Sequential  Life  Testa  in  the  Exponential  Case",  by  B.  Epstein  and 
M.  Sobel.  Issued  January  31,  1954,  as  Technics).  Report  No,  8. 


published,  accepted  for  publication,  or  submitted  for  publication 
£.  Epetein,  "Statistical  Problems  in  Life  Testing",  Proceedings  of 
the  Seventh  Annual  Convention  of  the  American  Society  for  Quality 
Control,  pp.  385-398,  1953« 

B.  Epstein  and  M.  Sobel,  "Life  Testing",  Journal  of  the  American 
Statistical  Association  £8,  <<86-502,  1953o 

B,  Epstein  and  C.  K.  Tsao,  "Seme  Two  Sample  Tests  Based  on  Ordered 
Observations  from  an  Exponential  Distribution",  Annals  of  Mathe- 
matical Statistics  2^,  458-466,  1953* 

B,  Epstein  and  M.  Sobel,  "Some  Theorems  Relevant  to  Life  Testing 
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Annals  of  Mathematical  Statistics. 

B,  Epstein,  "Seme  Results  on  Truncated  Life  Tests  in  the  Exponential 
Case".  Submitted  for  publication  in  the  Annals  of  Mathematical 


statistics 


(6) 


Ec  Epstein,  "Tables  for  the  Distribution  of  the  Number  of 
E>n«sdances,!o  Submitted  for  publication  in  the  Annals  of  Mathe- 
matical Statistics,, 

(7)  C.  K.  Tsao,  "An  Extension  of  Massey's  Distribution  of  the  Maximum. 
Deviation  Between  Two  Sample  Cumulative  Step  Functions",, 

Submitted  for  publication  in  the  Annals  of  Mathematical  Statistics, 

Other  papers  based  on  this  research  or  its  extensions  are  in  various 
stages  of  preparation.  Appropriate  acknowledgement  will  be  made  of  support 
by  the  Office  of  Naval  Research. 

Co  Several  papers  have  been  presented  either  by  title  or  in  person  at 
scientific  meetings.  These  are: 

(1)  "Life  Testing",  by  B.  Epstein  and  M.  Sobel,  Sampling  inspection 
Conference,  Stanford  University,  August,  1951o 

(2)  "Some  Tests  Based  on  the  First  r Ordered  Observations  Drawn  from 
an  Exponential  Distribution",  by  B.  Epstein  and  M.  Sobel. 

Christmas  meeting  of  the  Institute  of  Mathematical  Statistics, 
Boston,  Massachusetts,  December,  1951* 

(3)  "Some  Theorems  Relevant  to  Life  Testing",  by  B.  Epstein  and 
M.  Sobel,  December,  1951* 

(O  "A  Method  for  Reducing  the  Time  to  Complete  Certain  Fatigue 
Experiments",  by  L.  G.  Johnson.  DeceBshRr.  1951s 

(5)  "Efficiency  of  Estimators  of  ths  Mean  of  an  Exponential  Distri- 
bution Based  Only  on  the  r *th  Smallest  Observation  in  an  Ordered 
Sample",  by  B.  Epstein,  Sumner  meeting  of  the  Institute  of  Mathe- 
matical Statistics,  East  Lansing,  Michigan,  September,  1952. 
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{6)  "On  Truncated  Rules  of  Action",  by  vpstein,  September,  1952° 

(7)  "An  Extension  of  Massey,s  Distribution  of  the  Mnxinura  Deviation 
Between  Two  Sample  Cumulative  Step  Functions  ”,  by  C.  K.  Tsao, 
September,  1952° 

(8)  "Some  Two  Sampi  Testa  on  the  Exponential  Distribution",  by 
B.  Epstein  and  C.  K,  Tsao,  September,  1952q 

(9)  "A  Non-Par ametric  Two  Sample  Life  Test",  by  B.  Epstein,  Christmas 
meeting  of  the  Institute  of  Mathematical  Statistics,  Chicago, 
Illinois,  December,  1952* 

(10)  "Statistical  Problems  in  Life  Testing",  by  B.  Epstein,,  Invited 
address  on  session  devoted  to  Life  Testing  of  Electrical  and 
Electronic  Equipment  at  the  Seventh  Annual  Convention  of  the 
American  Society  for  Quality  Control,  Philadelphia,  Pennsylvania, 
May,  1953*  This  talk  was  also  given  by  invitation  at  a seminar 
on  Performance  and  Reliability  of  Complex  Assemblies  held  at 
Storre,  Connecticut,  August  26-28,  1953o 

(11)  "Sequential  Life  Tests  in  the  Exponential  Case",  by  B„  Epstein 
and  Me  Sobel,  Christmas  meeting  of  the  Institute  of  Mathematical 
Statistics,  Washington,  D.C,,  December,  1953° 
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Iff,  the  results  obtained  ur»ier  OilC 

1-  Tests  of  hypotheses 

As  mentioned  at  the  beginning,  the  principal  objective  of  the 
research  was  to  develop  statistical  techniques  of  estimation  and  decision 
making  which  make  maximum  use  of  the  information  arising  from  life  and  fatigue 
tests.  We  first  sketch  briefly  what  has  been  done  along  the  lines  of  decision 
making.  Unless  other-  specified,  we  assume  in  the  sequel  that  the  under- 
lying distribution  of  life  is  given  by  the  exponential  p.dof0 
•,  -x/9 

f(x}8)  « £ e , x > 0,  0 > 0. 

Suppose  we  are  interested  in  the  problem  of  testing  the  hypothesis  H : 0 » 9 

o o 

against  the  alternative  H^:  0 ■ 0^  < 0Q,  with  prescribed  Type  I error  *•  a 

and  Type  IT  error  ■ 0.  We  have  given  non-sequential , truncated,  and 

purely  sequential  test  procedures  for  carrying  out  this  decision  problem. 

In  all  tests  we  start  at  time  t & t ■ 0 with  n items  drawn  at  random  from 

o 

the  underlyir^  p.d.f.  If  items  which  fail  on  test  are  not  replaced,  we 
say  that  we  have  a no n-replacemsnt  situation.  If  items  which  fail  on  test 
are  replaced  at  once  by  new  items  drawn  from  the  same  underlying  p„d.f. , 
we  say  that  we  have  a replacement  situation.  Bj  a non-sequential  procedure 
we  mean  one  where  we  do  not  make  a decision,  except  at  the  very  end. 

Truncation  of  a life  test  may  be  with  respect  to  the  maximum  number  of 
failures  allowed  to  occur  before  termination  of  the  test,  or  with  respect 
to  a waxiaUm  allowed  tine  of  exparinentation  Or  wtu.  As  the  name  implies, 
sequential  tests  make  use  of  all  of  tho  information  as  it  becomes  available. 

A novel  and  very  interesting  feature  of  sequential  life  test  procedures  is 
that  decision?  can  now  be  made  continuously  in  time.  Auong  the  explicit 
results  obtained  are  such  useful  quantities  as  L(0),  the  probability  cf 
accepting  9 * 0Q  when  9 is  truej  5g(r),  the  expected  number  of  items  failed 


s 


in  reaching  a decision;  and  Eg(t),  the  expected  waiting  tine  to  reach  a 
decision.  These  results  make  it  possible  to  design  life  test  procedures 
for  testing  3^  against  St,  with  prescribed  errors  a and  3 at  the  en  QJLest 
overall  cost  in  time  and  number  of  items  failedo 

All  of  the  results  ore  in  Al,  AU,  K8t  Bl,  B2,  and  B5»  In 
addition,  useful  two  sample  life  test  procedures  of  a nan-sequential  nature 
are  given  i . A3,  B3.  The  tests  are  simple  to  apply  since  they  can  be 
reduced  tc  equivalent  F tests  in  most  cases.  A sequential  two  sample 
result  has  also  been  obtained  and  the  manuscript  is  being  p re  pa  red  0 
2<,  Estimation  procedures 

When  one  turns  to  estimation,  we  have  obtained  results  in  Al.  B5, 
in  the  case  where  n items  are  placed  on  life  test  and  where  the  test  is  con- 
tinued until  the  r :th  failure  occurs.  Let  x.  be  the  total  time 

i,n 

(measured  from  the  beginning  of  the  experiment)  which  elapses  until  the  i'th 
failure  occurs.  Then  it  can  be  ptoved  in  the  ncn-replacement  case  that 


(1) 


0 


♦ x 


2,n 


♦ x 


* (n-r)  *r,n 


r.n 


is  a "best"  estimate  of  0 in  the  sense  of  being  maximum  likelihood,  minimum 
variance,  efficient,  and  sufficient.  In  the  replacement  case  the  "best" 
estimate  is 


(2) 


A 

e 

r,n 


n x 


r.n' 


/_ 

,/r 


/s  2 

In  either  case  2r  Qf  g/0  is  distributed  as  X (2r)0  From  the  latter  fact 
we  have  a ready  means  for  finding  confidence  interval  estimates  for  0 based 
on  knowledge  of  the  first  r failure  times. 


In  the  previous  paragraph  the  life  test  was  continued  until  a 
preassigned  number  of  failures  occur.  Suppose  experimentation  is  iniuiatec 

vdth  n items  and  truncated  at  a preassigned  time  t”.  In  this  case,  k,  the 

* 

number  of  items  which  fail  in  a time  interval  of  length  t , is  a random 

variable.  If  we  have  a replacement  procedure,  then  the  life  test  expert  merit 

becomes  a Poisson  process  having  a failure  rate  of  A " n/8,  Known 

estimation  procedures  for  the  Poisson  process  can  then  be  applied  to  find 

"best"  estimates  for  A and  thus  for  0.  In  the  non- replacement  case 

k 


(3) 


9 » 


r*iD  + 

i-i  i,n 


(n-k)t 


, k 0;  1,  2,  . • . , n 


is  a maximum  likelihood  estimate  for  9*  However  it  has  no  simple  distribution 
In  the  asymptotic  sense  (i.e.,  as  n and  k increase)  we  can  say,  however, 
that  (3)  is  very  nearly  optimum. 

An  interesting  class  of  estimation  problems  arises  in  the 
following  t'sy.  Consider  the  decision  procedures  introduced  at  the  beginning. 

In  the  course  of  reaching  a decision  data  sure  collected.  How  can  these  data 
best  be  used  to  estimate  9?  This  will,  of  course,  be  recognized  by  many 
people  as  a problem  which  has  aroused  considerable  interest  of  late.  No  very 
good  answers  can  be  given,  except  when  the  number  of  observations  becomes 
large.  We  have  four  id  a number  of  results  along  these  lines,  which  we  think 
are  (jultf  useful*  For  example,  we  have  shown  how  we  can  make  best  estimates 
when  information  comes  from  several  experiments.  Essential  in  this 
connection  is  a statistic  which  ws  call  total  life. 

It  is  appropriate  to  mention  certain  results  which  may  , 
frequently  be  useful  in  practice,  because  of  their  great  simplicity.  Notice 
first  that  according  to  equation  (2),  no  information  is  lost,  in  the  estimation 
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of  the  mean  ' if s 9 in  t,h*»  reDlaeement  case,  if  one  uses  x alone,, 

r#r. 

Tins  is  equivalent  to  saying  that  x is  sufficient  for  estirating  9 

r9n  " 

in  the  replacement  case.  In  the  non-re Dlaceaent  C'ise  x is  not 

*’»n 

sufficient  for  estimating  S.  However,  it  is  shown  in  A2  that  very  little 

information  is  lost  {in  the  exponential  case)  if  we  retain  only  the  value 

of  (the  time  of  the  r'th  failure)  and  forget  about 

r,n 

y,  x_  x , (the  times  when  the  first  (r-1)  items  failed),,  This 

x,n  C|ii  r-i,n 

result  makes  estimates  of  mean  life  and  percentll*  much  easier  to  calculate,, 
It  also  renders  it  unnecessary  to  maintain  exact  records  of  the  time,, 

Some  useful  asymptotic  results  have  also  been  obtained.  By  and 
large  these  show  that  excellent  point  and  interval  estimates  of  the  mean 
life  6 can  often  be  made,  even  if  one  does  not  know  the  exact  times  to 
failure.  Thus,  for  example,  consider  a situation  wtcr«  1CGC  tubes  are  eacn 
subjected  to  a 500  hour  life  test.  It  turns  out  that  knowing  k,  the  number 
of  tubes  which  fall  to  survive  500  hours,  is  about  as  good  as  knowing  all  k 
failure  times.  Of  course,  one  of  our  presuppositions  is  that  the  under- 
lying Po  d«  fo  is  exponent  laic 

3.  Some  other  results  on  exponential  life  tests 

In  B4  we  give  a number  of  lemmas  and  theorems  which  are  of  interest 
in  the  general  theory.  These  results  furnish  a basis  for  finding  "best" 
estimates  of  9 from  knowledge  about  the  times  when  the  first  r^  failures 
(ri  - ni-*  i " 1*  2*  .....  k)  occur  in  k different  experiments,,  The  under- 
lying p.d.f.  *s  are  now  generalised  so  that  they  are  two-parameter  in  nature, 
i.e.,  of  the  flora  ^ e > 0,  9 > 0, ‘i  - 1,  2,  ...,  k.  The  A 

may  be  the  same  or  different,  known  or  unknown.  9 is  unknown  and  common  to 
all  k life  distributions.  The  A^s  can  be  interpreted  as  minimum  life  or  as 
a sensitivity  limit  (in  fatigue  tests),. 
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In  CU,  the  vx*rk  is  extended  to  the  Vfeifcull  distribution,  \iiere  tha 
e.d.f.  of  life  is  F(xj8)  ^ 1 - 8-(*/e)  ^ x > 0,  9 > 0.  The  exponential 
case  corresponds  tc  having  b * lc  In  soae  applications  (for  example,  to 
ball  bearing  fatigue  failures)  b is  known  fairly  well.  This  makes  it 
possible  to  use  exponential  theory  after  certain  minor  modifications  are  mads* 

It  was  mentioned  earlier  that  an  important  statistic  in  the 
exponential  case  is  something  we  call  "total  life".  Briefly,  it  is  defined 
as  follows.  Let  life  testing  casntence  at  time  t ■ t_  * 0 with  n items  0 
As  the  life  test  proceeds,  there  will  be  certain  times  0 < t^  < < ...  < tk  < 

when  an  abrupt  change  occurs.  The  t^'s  may  be  random  variables  or  times 
fixed  in  advance.  By  an  abrupt  change  we  mean  such  occurrences  as  the 
failure  of  one  of  the  items  under  test,  the  addition  of  new  items  to  these 
still  on  test,  or  the  removal  of  items  from  the  teat  before  they  fail.  If 
n^  is  the  number  of  items  tested  in  the  half-open  interval  [t0  t<  then 
the  observed  total  life  T(t)  in  the  interval  [0,t]  is  defined  as 


♦ oo  f 


(4) 


T(t) 


£ 


- V * °k(t  - V • 


In  (4),  k abrupt  changes  occur  in  [09t]  , In  a manuscript  called  "Remarks 
on  a Statistic  Useful  in  Life  Testing"  we  find  the  distribution  of  the 
statistic  and  some  of  its  properties  in  special  cases.  This  statistic 
makes  it  possible  to  treat  estimation  problems  for  replacement,  non- re  pi  •ce- 
ment, truncated,  suspended,  and  sequential  life  tests  as  special  cases  of  a 
general  theory.  It  will  be  seen  in  a later  section  that  when  people  in 
inspection  compute  a life  test  rating  for  a sample  of  tubes,  they  are  in 
reality  finding  the  total  life  for  a special  situation. 
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Uo  Some  non-parametric  life  tests 

In  A6  and  A7  we  give  some  non-pa rametric  two  sample  life  teot«0 
Taking  advantage  of  the  fact  that  observations  occur  in  order,  the  decision 
procedure  is  terminated  at  time  t ■ max(xr,yr>,  where  r is  preassigned  and 
of  course  < n,  the  common  sample  size0 

Cr.e  of  the  non-parametrlc  procedures,  A6,  makes  essential  use  of 
the  theory  of  exceedances,  while  the  other  procedure  A7,  ia  a truncated 
maximum  deviation  test  of  the  Kolaogoroff , Smirnov,  Massey,  Z.  W.  Bimbaum 
type0  In  the  course  of  this  work  tables  which  will  be  useful  not  only 
in  life  testing  but  also  in  flood  and  drought  problems  have  been  .jsd  out. 
Exceedance  tables  are  given  for  r * l(l)n  and  n • 2(1)20(5)50.  Tables  of 
the  distribution  of  the  maximum  deviation  in  truncated  c.d.f. '»  have  been 
worked  out  for  n - 1(1)10(5)40  and  r * 1(1)  „ 

Of  course,  the  big  question  in  any  non- parametric  test  is  now 
good  is  the  power?  We  have  obtained  experimental  0„C.  curves  for  the  trun- 
cated maximum  deviation  and  exceedance  tests  for  the  case  where  the  underlying 
p0d„fe 9 s are  normal  with  O*  ■ 1.  Two  hundred  pairs  of  samples  of  size  10 
each  were  drawn  from  Wold's  table  of  normal  random  deviates.  Associating 
the  letter  X with  one  of  the  samples  in  each  pair  and  T with  the  other,  we 
test  X against  T,  X against  Y ♦ 1,  X against  I ♦ 2,  snd  Z against  Y * 3. 
Experimental  O.C.  curves  were  also  found  for  the  conventional  mm,  rank  sum, 
and  maximum  deviation  tests  (based  on  complete  sample  c.d.f, 's),  using  the 
same  set  of  200  pairs  of  samples.  All  tests  were  controlled  in  such  a way 
that  the  probability  of  rejecting  the  null  hypothesis  when  true  was  o05<> 

We  also  found  experimentally  the  expected  number  of  observations 

required  to  reach  a decision,  as  a function  of  d - (the  distance 

separating  the  means  of  the  two  normal  distributions)  for  the  exceedance  and 
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truncated  maximum  deviation  teets0  The  results  ?jndicate  that  while  the 
exceedsrrce  and  truncated  m^-jclmiyn  deviation  test"  have  better  power  than  tiie* 
run  test  and  worse  power  than  the  V» ilcoxon  rank  test,  there  is  •?,  very  aub* 
stantial  reduction  in  E^s).  This  is  due  to  the  fact  that  we  are  taking 
advantage  of  the  time  ordered  nature  of  the  life  test  data.  Another  curious 
fact  seems  to  be  that  for  the  class  of  alternatives  studied,  ?(x)  vs.  F(x*d) 

(F  normal),  a truncated  maximum  deviation  test  has  virtually  as  good  power 
as  does  the  standard  maximum  deviation  test  based  on  complete  sample  c.d.f„9s0 
Of  course  we  are  well  aware  of  the  fact  that  any  non-parametric 
test  based  only  on  the  initial  part  of  a distribution  can  be  made  to  look 
bad  against-  certain  kinds  of  alternatives.  However,  there  are  certainly 
many  cases  in  practice  where  the  alternatives  are  sufficiently  well-behaved 
or  enough  in  known  a priori  to  justify  giving  these  procedures  serious 
consideration.  They  are  very  simple  to  use  and  require  so  little 
computation,, 

V6  Related  work  by  other  mathematical  statisticians 

At  the  time  when  this  research  w*3  begun,  the  published  literature 

dealing  with  the  possibility  of  making  use  of  order  to  reduce  the  time  of 

experimentation  or  the  number  of  observations  or  both  was,  as  far  as  we  can 

/ 

ascertain,  limited  to  three  papers  (1,2,3).  A resume  of  these  papers  is 
given  in  B2« 

^1)  P.  h.  Jacobson,  "The  relative  pow<r  of  three  statistics  for  small  sample 
destructive  tests",  Journsl  of  the  American  Statistical  Association,  4?. 
575-564,  1947. 

(2)  J.  F*  Walsh,  "Some  estimates  and  testa  based  on  the  r smallest  values  in 
a sample".  Annals  of  Mathematical  Statistics,  21,  386-397,  1950. 

(3)  Max  Kalperin,  "Maximum  likelihood  estimation  in  truncated  samples". 

Annals  of  Mathematical  Statistics,  2£,  226-238,  1952* 


In  order  to  see  the  relevance  of  work  done  by  others  since  the 
appearance  of  these  three  papers,  we  should  mention  the  relationship  between 
Poisson  processes  and  exponential  distributions.  It  is  veil  known,  for 
example,  that  the  time  interval  between  successive  events  in  a Poisson  process 
characterised  by  the  rate  of  occurrence  A , is  a random  variable  following  a 
continuous  probability  law  described  by  the  exponential  p.d.f^  A • , 

t > 0.  It  should  be  noted  further  that  if  one  has  n items  on  life  test  and 
replaces  failures  as  soon  as  they  occur  by  new  items,  then  we  are  essentially 
dealing  with  a Poisson  process  having  parameter  A ™ n/9,  if  the  underlying 
Pod.fo  of  life  is  given  by  ^ x > o,  0 > 0.  Thus  it  is  clear  that 

any  iesults  obtained  on  Poisson  processes  oust  be  immediately  applicable  to 
exponential  life  test  situations  with  replacement,, 

A.  Birnbaum  (4,  5 *6,7)  has  discussed  this  connection.  He  has  found 
some  sequential  and  non-sequential  test  for  comparing  Poisson  population? 
which  can  be  used  to  give  two  sample  life  tests. 

Leo  Goottaan  (8)  has  written  an  interesting  paper  on  life  testing. 

He  takes  up  the  problem  of  comparing  the  longevity  of  two  or  mors  type  of 
equipment  where  it  is  not  convenient  to  identify  or  keep  records  of 


(4)  A.  Birnbaum,  "Sequential  tests  and  estimates  for  comparing  Poisson  popu- 
lations" (Abstract  No.  25,  Annals  of  Mathematical  Statistics  2£,  Dec.  1952). 

(5)  A.  Birnbaum,  "Some  experimental  designs  for  comparative  life  testing" 
(Abstract  No.  14,  Annals  of  Mathematical  Statistics  2J±,  March,  1953)o 

(6)  A.  Birnbaum,  "Statistical  methods  for  Poisson  processes  and  exponential 
populations"  (Mimeographed  material  distributed  at  Starrs,  Connecticut, 
August,  1953)o 

(7)  A.  Birnbaum,  "Sano  procedures  for  comparing  Poisson  processes  and 
populations",  to  appear  in  Biometrika0 

(8)  Leo  Goodman,  Methods  of  measuring  useful  life  under  operational 
conditions".  Journal  of  the  American  Statistical  Association,  Z*8, 

503-530,  1953o 
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Individual  items*  He  works  under  the  assumption  that  all  items  are  exposed 
to  a constant  risk,  and  this  is  equivalent  to  assuming  an  exponential  p.d.f* 
Ke  finds  it  convenient  to  treat  the  problem  discretely  (thus  involving  the 
negative  binomial)  while  we  have  treated  life  testing  from  the  continuous 
point  of  viewo  The  introduction  in  Goo 'ta an 5 a paper  summarizes  very  well 
\£i&t  the  paper  does*  This  introduction  is  now  given  verbatim* 

"A  comparison  of  the  longevities  of  two  or  more  types  of  equipment 
under  operational  conditions  where  it  is  not  convenient  to  identify  or  keep 
records  of  individual  items  can  be  made  by  adopting  a certain  replacement 
policy  and  observing  its  effect  on  the  composition  of  the  population*  When 
only  two  types  are  being  compared,  for  example , the  policy  might  be  that 
when  an  item  fails  it  will  be  replaced  by  one  of  the  opposite  type.  Then 
the  composition  of  the  population  at  any  time  (that  is,  the  proportions  of 
the  different  types  among  all  the  items  in  use)  will  depend  upon  the 
original  composition  of  the  population,  the  time  elapsed,  and  the  longevities 
of  the  different  types.  Since  the  original  composition  and  the  elapsed  time 
are  known,  by  determining  the  new  composition  of  the  population  we  can 
obtain  information  concerning  the  longevities  of  the  different  types  of 
equipment* 11 

An  interesting  and  intrinsic  feature  of  sequential  life  test  pro- 
cedures is  that  decisions  can  be  made  continuously  in  time.  This  raises 
seme  new  and  important  theoretical  questions*  Ae  posed  the  problem  as  it 
arises  in  life  testing  in  Cl.  The  solution  is  outlined  in  B1  and  given  in 
detail  in  A8«  One  of  the  main  results  is  a fundamental  identity  relating 
Eg(t),  the  expected  waiting  time  to  reach  a decision  and  Eg(r),  the  expected 
number  of  items  failed.  This  turns  out  to  be  a consequence  of  a general 


theorem  by  Doob  (9)  on  continuo'os  parameter  martingales.  Our  proof  in  AS 
wae  obtained  independently  of  Doob 8 s work  and  without  us  in-  the  heavy 
technical  machinery  required  to  handle  the  general  problem  treated  by  Doob-, 
Recently  Dvoretsky,  Kiefer,  and  Wolfowitz  (10,11)  have  treated 
sequential  procedure;-  in  stechastic  processes  with  a continuous  time  para- 
meter, When  the  stochastic  process  treated  is  Poisson,  the  results  can  be 
used  in  life  testing.  Wo  might  add  that  a great  deal  of  numerical  work 
done  here  has  shewn  that  the  approximations  that  we  give  in  AS  for  EQ(t) 
and  EQ(r)  are  good  enough  for  all  practical  purposes.  The  exact  formula® 

(7)  require  a great  deal  of  time  and  labor. 

Material  relevant  to  some  of  the  estimation  problems  in  life 
testing  can  be  found  in  work  on  the  Poisson  distribution  by  a number  of 
British  statisticians  (12,13, 14,15,l6)0 

(9)  J.  L.  Doob,  ^Stochastic  processes’*,  John  Wiley  and  Sons,  1953® 

(10)  A.  Dvoretsky,  J.  Kiefer,  and  J.  Wblfowits,  "Sciential  decision  problems 
for  processes  with  continuous  time  parameter.  Testing  hypotheses’*, 
Annals  of  Mathematical  Statistics,  2^,  254-264,  1953° 

(11)  A.  Dvoretsky,  J.  Kiefer,  and  J.  Wolfowitc,  "Sequential  decision  problems 
for  processes  with  continuous  time  parameter.  Problems  of  estimation". 
Annals  of  Mathematical  Statistics  2^,  403-415,  1953° 

(12)  D.  G.  Kendall,  "Stochastic  processes  and  population  growth",  Journal 
of  the  Royal  Statistical  Society,  Ser.  B. , 11,  230=264,  1949° 

(13)  P°  A.  P.  Moran,  "Estimation  methods  for  evolutive  processes".  Journal 
of  the  Royal  Statistical  Society,  Ser.  , 13 « 141—146,  1951° 

(14)  F°  J.  An  scorn b-a,  'Sequential  Estimation",  Journal  of  the  Royal 
Statistical  Society,  Ser.  B. , 1£,  1-29,  1953® 

(15)  M*  S.  Bartlett,  "Approximate  confidence  intervals".  Biomet rika,  ZjQ, 
13-19,  1953° 

(16)  M.  S.  Bartlett,  "On  the  statistical  estimation  of  mean  life  time, 
Philosophical  Magazine  44.  1953. 
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Our  work  on  exceedances  extends  earlier  work  cl  Gursbel  and 
von  Schelling  (17)  and  has  relevance  to  the  work  of  Hosteller  and  Tukey  (16,19) 
on  slippage 0 

Our  studies  on  the  power  of  non --parametric  life  tests  have 
connections  on  the  theoretical  side  with  recent  work  by  Lehmann  (20)  and  on 
the  empirical  side  with  sampling  studies  on  the  comparative  power  of  various 
ncn-parametric  tests  by  Teichroew  and  Dixon  (21,22). 

VI,  Some  remarks  on  the  applications  of  this  work 

In  B1  we  devote  some  space  tc  the  exponential  distribution  and  its 
role  in  the  life  testing  of  electron  tubes.  For  convenience  we  bring  together 
several  refe  snces  (23,24,25,26,27,2 6)  dealing  with  this  question.  Reference 


(17)  E.  J.  Qumbel  and  H.  von  Schelling,  "The  distribution  of  the  number  of 
exceedances",  Annals  of  Mathematical  Statistics,  21.  247-262,  1950. 

(18)  Frederick  Hosteller,  "A  k- sample  slippage  test  for  an  extreme  population" 
Annals  of  Mathematical  Stalls  tic  % 12,  58-65,  1948. 

(19)  F.  Hosteller  and  J.  W.  Tukey,  "Significance  levels  for  a k-sample 
slippage  test",  Annals  of  Mathematical  Statistics,  21.  123-123,  1950. 

(20)  E.  L-  Lehmann,  "The  power  of  rank  tests".  Annals  of  Mathematical 
Statistics,  2^,  23-42,  1953o 

(21)  D.  Teichroew,  "Bapirlcal  sampling  distributions  II",  N.B.S.  report  1621, 
April,  1952. 

(22)  Vi.  J.  Dixon  and  D.  Teichroew,  "Some  sampling  results  on  the  power  of 
non-parametric  tests  against  normal  alternatives",  paper  presented  at 
Institute  of  Mathematical  Statistics,  December  1953- 

(23)  D*  J.  Davis,  "An  analysis  of  some  failure  data".  Journal  of  the  American 
Statistical  Association,  113-150,  1952* 

(24)  C.  R.  M.  Tuttle  and  A.  R.  Frank,  '‘Inventory  control  methods  applied  to 
electronic  tubes",  a paper  included  in  Logistics  Papers,  Issue  8, 
November  16,  1951  - February  15,  1952,  Appendix  I.  Issued  by  the 
George  Washington  University  Logistics  Project* 

(25)  E.  S.  Rich,  "Experience  with  receiving  type  vacuum  tubes  on  the  Whirl- 
wind Computer  Project",  Report  R-194,  Project  Whirlwind,  Servomechanisms 
Laboratory,  Massachusetts  Institute  of  Technology,  February,  1951- 
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23  is  quite  general  and  includes  examples  from  a variety  of  fields  while  the 
rest  of  the  references  deal  primarily  with  electron  tube  life„ 

While  the  evidence  contained  in  the  papers  just  cited  strongly 
suggests  that  the  exponential  distribution  of  life  is  a reasonable  assumption 
to  make  in  the  case  of  tube  failures,  it  is  probably  only  a first  approxi- 
mation to  reality.  For  example  in  reference  28  the  exponential  ped0f„  of 
life  was  obtained  after  eliminating  a large  nisnber  of  early  failures  due  to 
all  kinds  of  mechanical  defects, shorts,  open  circuits,  etc.  The  same  point 
has  been  emphasized  in  recent  papers  by  McELwee  and  others  (29,30)o 

During  the  past  two  years  the  subject  oX  Life  Testing  has  been  a 
topic  of  discussion  on  three  different  occasions  at  national  meetings.  The 
first  of  these  took  place  in  July,  1952,  at  the  Simmer  Statis  tics  Conference 
sponsored  by  tie  University  of  North  Carolina  and  held  at  Blue  Ridge,  North 
Carolina.  Participating  in  the  discussion  were  J.  R»  Steen  and  R.  D.  Wilde 


(26)  N.  W.  Lewis,  "Note  on  the  exponential  distribution  in  statistics". 
Post  Office  Electrical  Ehgineers  Journal  41,  10-12,  1948* 

(27)  D.  K.  Gannett.  "Detemircticr.  of  the  average  life  of  vacuum  tubes". 
Bell  Telephone  Laboratory  Record,  370-381*  1940, 

(28)  J.  E.  M.  Lagaaee  and  W.  K»  Dean,  "Tubes  at  Work",  Electronics,  56-62, 
1941- 


(29)  M.  A.  Acheson  and  E.  M.  He  El  wee,  "Concerning  the  reliability  of 
electron  tubes",  The  Sylvania  Technologist,  £,  April,  1951. 

(30)  A.  J.  Heitner  and  A.  L.  Wilson,  "Analysis  of  Kew  Gardens  premium  tube 

^ J OaJI  MtaMl  a VI  A TX»  — — Tmm  OP OA  I^M.t  l'<*  tl  V - 

JLLAC  | t/JfX  V«1U«  i^LOVVAXV  * AAAAUL  XllVO  USiUOtiO 

Gardens  15,  Long  Island,  New  Xork,  Hay,  1951» 
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Sylvania  lectric  Products,  Inc* , J,  A.  Davies  of  General  E7*ctric 
Company,  and  J,  R_  Ransom  of  DuPont.  The  present  writer  was  unable  to  attend 
the  conference  in  person,  but  does  have  mimeographed  copies  of  the  papers 
presented  by  Steen,  Wilde,  and  Davies  (31. 32, 33, 34)*  The  following  remarks 
are  pertinent: 

(1)  All  of  the  speakers  stressed  the  existence  of  essentially  two  kinds  of 
failures,  one  of  which  occurs  early  in  life,  the  other  of  which  is 
associated  with  a gradual  and  prolonged  weaiw>ut  process.  It  was 
generally  agreed  that  if  the  first  kind  of  failure  "ould  be  eliminated, 
then  the  assumptions  of  a constant  failure  rate  (i.e. , exponential  life) 
was  reasonable. 

(2)  It  would  seem  that  the  results  obtained  under  this  research  contract  are 
laying  the  foundations  for  a rational,  inspection  test  procedure.  Steen 

stated  in  his  talk  that  to  be  acceptable  a life  test  procedure  must 
yielc  *he  required  information  about  the  tubes  as  economically  as 
possible,  i<>eo,  should  provide  a basis  for  action  which  minimizes  the 
over-all  test  cost.  This  means  getting  the  most  infoimation  in  the 
shortest  possible  time  and  with  tne  smallest  number  of  failures.  This 
is  precisely  the  objective  of  the  research  project. 

(31)  J.  R.  Steen,  "Life  testing  of  electronic  tubes”. 

(32)  R.  D.  Wilde,  "Nature  of  rate  of  failure  curves",, 

(33)  R.  D.  Wilde,  "An  example  of  a statistically  designed  experiment  in  a 
radio  tube  manufacturing  process "« 

(34)  J.  A.  Davies,  "Life  test  acceptance  sampling  methods". 

Items  30,  31*  32,  33  ware  all  presented  at  the  North  Carolina 
Conference. 
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(3)  Wilde  found  the  results  of  Ai  very  useful  in  estimating  Lube  lif(sc 

(!».)  Davies®  concern  was  with  a variety  of  sampling  plans  3uch  as  the  JAK-1A, 

JTG-II,  and  the  so-called  G.E„  Plan.  One  of  the  essential  features  of 

all  of  these  plans  is  that  the  decision  to  accept  or  reject  a lot  is 

based  on  a quantity  known  as  a life  test  rating.  This  is  widely  used  in 

the  electrical  industry  and  is  described  in  various  places  (29,35*36). 

Briefly,  a life  test  rating  is  computed  as  follows.  Let  n tubes  be  nn 

for  a maximum  of  T hours.  Suppose  r tubes  fail  at  times  x.,x0,...,X- 

before  7.  Then  the  total  observed  life  is  defined  as 

U “ » x.  ♦ (n-r)T.  and  the  life  test  rating  in  percent  is  simply 

i-1  1 

100  U/n?0  The  rule  of  action  is  to  accept  a lot  if  the  life  test  rating 
based  un  the  sample  exceeds  some  value  (e„g. , 90%),  Otherwise  the  lot 
is  rejected* 

We  should  like  to  remark  that  the  quantity  U and  others  like  it 


arise  in  a natural  way  when  one  deals  with  an  underlying  life  distribution 
which  is  exponential*  As  mentioned  at  the  end  of  section  IV  of  this  report, 
theoretical  work  on  the  statistic  which  we  call  "total  life"  is  very  relevant 
here.  Both  Davies  and  Steen  stress  the  need  for  developing  analytical 
methods  for  finding  the  O.C.  curves  for  procedures  such  as  the  G.E.  plan.  No 
such  methods  exist  for  the  G.E.  plan  and  apparently  it  has  been  necessary  for 
Davies  to  fall  back  on  empirical  sampling  procedures  to  gain  such 
information.  It  turns  out  that  the  work  we  have  done  c*»  wuuc&uou  uesu 
procedures  (Ai*.,  B5)  is  almost  made  to  order  in  this  connection.  The  truncated 
test  procedures,  while  not  identical  with  the  OLE.  procedure,  do  have  the  same 


(35)  E.  H.  ricELwee,  "Statistical  evaluation  of  life  expectancy  of  vacuum 
tubes  designed  for  long  life  operation".  Proceedings  of  the  Institute 
of  Radio  Engineers,  February,  1951« 


(36) 


M.  Juran,  "Quality  Control  Handbook",  Chapter  13,  McGraw-Hill,  1951 


objective  of  putting  a fixed  upper  limit  on  the  time  of  experimentation,,  In 
addition,  our  truncated  teste  possess  the  desirable  feature  that  all 
pertinent  properties  includin'  the  0„ C.  curve  can  be  worked  out  analytically 
in  any  case  of  practical  interest.  It  should  be  noted  that  the  sampling 
experiments  of  Davies  were  performed  under  the  assumptions  of  a constant  rate 
of  failure.  This  means  that  he  is  assuming  implicitly  that  the  underlying 
life  distribution  is  exponential^ 

At  the  Seventh  Annual  Convention  Of  who  Awe  rican  Society  for 
Quality  Control  held  in  Philadelphia  in  May,  1953;  there  were  two  sessions 
dealing  with  life  testing.  One  of  these  was  on  the  topic  "Rejkbility  of 
Electronic  Equipment  "•  Papers  were  given  by  Herd  (37)  and  Guild  (38). 

Herd  is  in  charge  of  statistical  work  at  Aeronautical  Radio,  Inc. , which, 
has  the  responsibility  of  investigating  the  reliability  of  military  electronic 
equipment  under  field  conditions.  In  this  work.  Herd  has  found  the  results 
of  our  research  to  be  very  useful. 

The  second  session  at  the  convention  dealing  with  life  testing 
was  on  the  topic  "Life  Testing  Electrical  and  Electronic  Equipment".  Papers 
were  given  by  Epstein  (Bl)  and  by  Davies  (3y).  In  B1  the  research  work 
done  or  the  statistics  of  life  testing  under  this  project  was  outlined. 

Paper  39  is  essentially  th-  same  as  Paper  34,  i.e„,  is  concerned  with 
various  sampling  plans  to  judge  the  acceptability  of  a lot  an  the  basis  of 
what  happens  to  a sample  on  life  teste 

(37)  G.  R.  Hard,  Application  of  statistical  methods  in  evaluating  perfor- 
mance of  electronic  equipment ",  Proceedings  of  the  Seventh  Annual  Con- 
vention of  the  American  Society  for  Quality  Control,  pp»  309-314,  1953° 

(38)  R.  D.  Guild,  "Statistical  appraisal  of  vacuum  tube  reliability n. 
Proceedings  of  the  Seventh  Annual  Convention  of  the  American  Society 
for  Quality  Control,  pp.  255-230,  1953® 

(39)  o.  A.  Tavies,  "How  reliable  is  your  life  test  procedure?"  Proceedings 
of  the  Seventh  Annual  Convention  of  the  American  Society  for  Quality 
Control,  pp.  255-266,  1953* 
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Or  August  26-28.  1953d  there  was  a seminar  on  "Performance  and 
Reliability  of  Complex  Assemblies"  hold  at  the  University  of  Connecticut, 
Stores,  Connecticut,  About  forty  people  from  all  parts  of  the  country 
attended.  Government,  industry,  and  universities  had  representatives  there. 
Much  of  the  discussion  concerned  itself  with  problems  of  life  and  fatigue  of 
components,  sub-assemblies,  and  assemblies,,  Paper  B1  was  presented  at  this 
conference,, 

In  connection  with  problems  of  reliability  we  should  like  to 
mention  an  interesting  paper  by  E,  W.  Pike  and  F.  C.  Lewis  (40)  given  before 
the  Institute  of  Radio  Engineers  in  Dayton  in  May,  1953» 

Tfc-  research  on  life  testing  is  giving  new  statistical  tools  for 
people  in  the  field  of  operations  research.  This  was  discussed  in  a recent 
paper  by  R.  I.,  Ackoff  (41).  The  following  pertinent  statement  is  taken 
from  the  first  page  of  his  paper: 

"Many  operations  research  problems  involve  questions  concerning  the 
maintenance,  replacement,  or  critical  strengths  of  equipment  or  of  per- 
sonnel, For  example,  in  the  military,  how  often  should  an  aer  plane  motor 
be  replaced,  or  tom  down,  or  rebuilt?  How  long  should  a pilot  or  infantry- 
man remain  in  combat?  How  such  pressure  can  a certain  thickness  of  armor 
plate  withstand?  In  industry  and  business  there  are  similar  questions.  How 
often  should  light  bulbs,  or  electronic  tubas,  or  transistors,  or  tires  be 
replaced?  When  should  an  automobile  motor  be  tom  down  and  rebuilt?  How 
long  should  a worker  be  kept  on  a repetitive  process?  Such  questions  as 
these  deal  with  what  is  called  the  life-span  or  fatigue  point  of  the  items 
or  personnel  involved." 

(40)  E.  W.  Pike  snd  F.  G.  Lewis,  "Testing  Components  for  High-Eslic bility 
Systems",  mimeographed  1953* 

(41)  R.  L.  Ackoff,  "Some  new  statistical  techniques  applicable  to  operations 
research".  Journal  of  the  Operations  Research  Society  of  America  1, 
10-17,  1952. 
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Some  applications  of  this  work  are  being  made  in  areas  ether 
than  electron  tubes,,  For  example,  Besse  Day  and  her  associates  at  the 
U.  3.  Naval  Experiment  Station,  Annapolis,  Md0 , are  interested  in  ball- 
bearing life.  They  are  trying  out  some  of  the  exponential  techniques 
developed  here  4a  subsequently  modified  by  Johnson  of  General  Motors  in  C4 
to  apply  to  the  Weibull  distribution.  This  dis  trltxition  seems  to  be  quite 
useful  in  fitting  data  arising  in  a variety  of  applications  (42,43).  The 
dose  connection  between  statistical  theories  of  strength  and  the  theory  of 
extreme  values  was  developed  by  the  present  writer  a few  years  ago  (44)  and 
this  explains  in  part  why  the  Weibull  distribution  plays  an  important  part 
in  applications.  A recent  paper  of  Freudenthal  and  Gumbel  (45)  is  relevant 
here.  Dr.  Day  has  found  the  Weibull  assumption  to  be  reasonably  satisfactory,. 
Some  interesting  work  on  battery  life  is  being  done  by 
Dr.  William  Buckland  who  is  head  of  the  Statistical  Section  in  the  Research 
and  Development  Section  of  the  London  Transport  Executive.  Ke  is  carrying 
out  extensive  studies  on  the  distribution  of  life  of  batteries  used  in 
diesel  buses.  The  life  distributions  are  expected  to  be  Type  III  or 
Weibull  rather  than  exponential, 

(42)  W.  Weibull,  nA  statistical  theory  of  strength  of  materials*1,  Vetenskaps 
Akad.  Hand.  No.  151,  1939,  "The  phenomenon  of  rupture  in  solids'*,  ibid.. 
No.  153,  1939, 

(43)  W.  Weibull,  "A  statistical  d ist rlbu tion  o f wide  applicability”. 

Journal  of  the  Applied  Mechanic*,  239-29 7.  September,  1951, 

(44)  Bo  Epstein,  "Statistical  aspects  of  fracture  problems".  Journal  of 
Applied  Physics,  1£,  140-147,  1948. 

(45)  A.  M.  Freudenthal  and  E.  J.  Gumbel,  "On  the  statistical  interpretation 
of  fatigue  tests".  Proceedings  of  the  Royal  Society  of  London,  Series  A, 
216.  309-332,  1953. 
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Jo  A«  Greenwood  of  the  li.  S.  Navy  Bureau  of  Aeronautics  has  done 


some  interesting  work  on  a serai-empirical  procedure  for  estimating  the  mean 


•-  f-  f*  t VT 


Life  in  hours  seems  to  be  normally  distributed  in 


this  application. 

The  last  three  applications  arose  from  persons!  ipntacts  and  corres- 
pondence. It  might  be  mentioned  that  a steadily  increasiig  arociait  of  corres- 
pondence indicates  that  there  is  considerable  interest  in  the  practical 
applications  of  the  work.  Scores  of  gomen— otal  and  industrial  organisations 
have  written  to  inquire  about  various  aspects  of  ths  research.  There  is  no 
doubt  in  my  own  mind  that  the  work  curried  out  under  this  project  will  in 
time  find  its  application  in  many  places,  including  the  biological  as  well  as 
physical  sciences. 
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